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Abstract 

Nonparametric statistics for distribution functions F or densities f = F' under qualitative shape 
constraints constitutes an interesting alternative to classical parametric or entirely nonparametric 
approaches. We contribute to this area by considering a new shape constraint: F is said to be bi-log- 
concave, if both logF and log(l — F) are concave. Many commonly considered distributions are 
compatible with this constraint. For instance, any c.d.f. F with log-concave density f = F' is bi-log- 
concave. But in contrast to log-concavity of /, bi-log-concavity of F allows for multimodal densities. 
We provide various characterisations. It is shown that combining any nonparametric confidence band 
for F with the new shape constraint leads to substantial improvements, particularly in the tails. To 
pinpoint this, we show that these confidence bands imply non-trivial confidence bounds for arbitrary 
moments and the moment generating function of F. 
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1 Introduction 

In nonparametric statistics one is often interested in estimators or confidence regions for curves 
such as densifies or regression functions. Esfimafion of such curves is fypically an ill-posed prob¬ 
lem and requires additional assumpfions. Inferesfing alfernafives fo smoofhness assumpfions are 
qualifafive consfrainfs such as, for insfance, monofonicify or concavify. 

Esfimafion of a disfribufion funcfion F based on independenf, identically disfribufed random 
variables Xi, X 2 , ■ ■ ■, Xn wifh c.d.f. F is common practice and does nof require resfricfive as¬ 
sumpfions. Buf nonfrivial confidence regions for cerfain functionals of F such as fhe mean do nof 
exisf wifhouf subsfanfial addifional consfrainfs (cf. Bahadur and Savage, 1956). 
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A growing literature on density estimation under shape constraints considers the family of 
log-concave densities. These are probability densities / on such that log / : —)■ [— 00 , 00 ) 

is a concave function. For more details see Bagnoli and Bergstrom (2005), Cule et al. (2010), 
Diimbgen and Rufibach (2009, 2011), Walther (2009), Seregin and Wellner (2010), Diimbgen 
et al. (2011) and the references cited therein. Most efforts in these papers are devoted to point 
estimation. Schuhmacher et al. (2011) obtain a nonparametric confidence region by combining the 
log-concavity constraint and a standard Kolmogorov-Smimov confidence region. But its explicit 
computation is difficult, and this is one motivation to search for alternative shape constraints in 
terms of the distribution function F directly. 

While many popular densities are log-concave, this constraint can be too restrictive in applica¬ 
tions with a multimodal density. In the present paper we consider a model with a new and weaker 
constraint on the distribution function: 

Definition (Bi-log-concavity). A distribution function F on the real line is called bi-log-concave 
if both log F and log(l — F) are concave functions from M to [— 00 ,0]. 

Many distribution functions satisfy this constraint. In particular, when F has a log-concave density 
/ = F', it is bi-log-concave (Bagnoli and Bergstrom, 2005). But indeed, bi-log-concavity of F 
is a much weaker constraint. As shown later, F may have a density with an arbitrary number of 
modes. Thus, we consider estimation of distributions under shape constraints for a wider family 
of distributions. 

The remainder of this paper is organized as follows: In Section we present characteri¬ 
sations of bi-Iog-concavity and explicit bounds for F and its density f = F'. In Section |3] 
we describe exact (conservative) confidence bands for F. They are constructed by combining 
the bi-log-concavity constraint with standard confidence bands for F such as, for instance, the 
Kolmogorov-Smimov band or Owen’s (1995) band. A numerical example with the distribution 
of CEO salaries (Wookidge 2000) illustrates the usefulness of the proposed method. The benefits 
of adding the shape constraint are pinpointed in Section It is shown that combining a reason¬ 
able confidence band with the new shape constraint leads to non-trivial honest confidence bounds 
for various quantities related to F. These include its density, hazard function and reverse haz¬ 
ard function, its moment generating function and arbitrary moments. All proofs are deferred to 
Section [51 
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2 Bi-log-concave distribution functions 


In what follows we call a distribution function F non-degenerate if the set 


J{F) := {x G M : 0 < F{x) < 1} 


is nonvoid. Notice that in the case of J{F) = 0 the distribution function F would correspond to 
the Dirac measure 6m at some point m G M, i.e. F{x) = l[x>m]- 

Our first theorem provides three alternative characterisations of bi-log-concavity which are 
expressed by different constraints for F and its derivatives. 

Theorem 1. For a non-degenerate distribution function F the following four statements are 
equivalent: 

(i) F is bi-log-concave; 

(ii) F is continuous on M and differentiable on J{F) with derivative f = F' such that 



( 1 ) 


for arbitrary x £ J(F) and t G M. 

(in) F is continuous on M and differentiable on J{F) with derivative f = F' such that the hazard 
function f/{I — F) is non-decreasing and the reverse hazard function f /F is non-increasing on 


J{F). 


(iv) F is continuous on M and differentiable on J{F) with bounded and strictly positive derivative 


f = F'. Furthermore, f is locally Lipschitz-continuous on J{F) with -derivative f = F” 
satisfying 



( 2 ) 


The set of all distribution functions F with the properties stated in Theorem [T] is denoted as 
J^bic- The inequalities Q in statement (iv) can be reformulated as follows: log / is locally Lip¬ 
schitz-continuous on J(F) with L^-derivative (log /)' satisfying 


(log(l-F))' < (log/)' < (logF)'. 


(An -derivative of a function h on an open interval J C M is a locally integrable function h' on 
J such that h{y) — h{x) = h'{t) dt for all x, y G J.) 
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Example (Bi-modal density). Consider the mixture 2“^A/’(—(5,1) + 2“^A/’((5,1) with 5 > 0. 
Numerical experiments showed that the corresponding c.d.f. F is bi-log-concave for <5 < 1.34 but 
fails to be so for 6 > 1.35. In case of (5 = 1.34, this distribution has a bi-modal density. The 
corresponding c.d.f. F is shown in Figure [TJa), together with the functions 1 -|- log F < F < 
— log(l — F), the inequalities following from log(l + y) < y for arbitrary y > —1. Bi-log- 
concavity means that the lower bound 1 -|- logF is concave while the upper bound — log(l — F) 
is convex. Figures [T]|2] illustrate the various characterisations of the bi-log-concavity constraint as 
given in Theorem In particular, Figure [TJb) shows the bounds from part (ii) for one particular 
point X G J{F). Figure l^a) shows the density / together with the hazard function //(I — F) 
and the reverse hazard function f /F. It is apparent that the latter two satisfy the monotonicity 
properties of part (hi). Figure|^b) contains the derivative /' together with the bounds —/^/(1—F") 
and /^/F as given in part (iv). 

While the previous example illustrates bi-log-concavity for a bi-modal density, the next exam¬ 
ple considers a multi modal density. 

Example (fe-modal density). For any integer k > 0 and a e(o,i), 

fix) ■= 1[0<X<1](1 + asin(27r/cx)) 

defines a probability density with k local maxima. The corresponding c.d.f. is given by F{x) = 
X + a(l — cos{2'Kkx))/{2'Kk) for x G [0,1], and one can easily deduce from Theorem[^(iv) that 
it is bi-log-concave if a is sufficiently small. 

Remark. For F G Fbic, its moment-generating function is finite in a neighborhood of 0. Pre¬ 
cisely, it will be shown in Section [^that 

{fGM; J e^^Fidx)<oo] = {-Ti{F),T2iF)) (3) 


with 


TiiF) 

T2iF) 


su /(^) I > 0, 

xejfp) F{x) 1= oo if inf(J(F)) > -oo, 

fix) [>0, 
sup -- < 

xeJiF)- x{x) ^=oo if sup(J(F)) < cx). 
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- 0.2 0.0 0.2 0.4 0.6 0.8 1.0 1.2 - 0.5 


(a) F with its concave lower and convex upper bounds. 



(b) F with the bounds given by Theorem 1 (ii). 



Figure 1: A bi-log-concave F with its bounds. 
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- 0.2 - 0.1 


(a) / with monotonic hazard and reversed hazard function as given by Theorem [T](iii). 



(b) /' with its bounds as given by Theorem [^(iv). 



-4 -2 0 2 4 

Figure 2: Different characterisations of a bi-log-concave F. 
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3 Confidence bands 


A confidence band for F G J^bic may be constructed by intersecting a standard confidence band 
for a (continuous) distribution function with this class J^bic- 


Unconstrained nonparametric confidence bands. Let Xi,... be independent random 
variables with continuous distribution function F. In what follows let {Ln,Un) be a (1 — a)- 
confidence band for F with 0 < a < 0.5. This means, Ln = Ln,a{- \ Xi,... ,X„) < 1 and 
Un = Un,a{- \ ^ 1 , ■ ■ ■, ^n) > 0 are data-driven non-decreasing functions on the real line such 
that Ln < Un pointwise and 


P[Ln{x) < F{x) < Un{x) for all X G M) = 1 — a. 


Example (Kolmogorov-Smimov band). A standard example for {Ln, Un) is given by 


.KS 


[Ln{x),Un{x)] := Fn{x) - '^,Fn{x) + 


n 


.KS 


y/n . 


n[o,i], 


where 

1 " 

Fn{x) := ~ ^Xi<x\i 
i=l 

and K,n% denotes the (1 — a)-quantile of sup^-gju n^/^|F(x) — F(x)|; cf. Shorack and Wellner 
(1986). Notice also that < yJ\og{2/a )/2 by Massart’s (1990) inequality. 


Example (Weighted Kolmogorov-Smimov band). Let X(i) < X( 2 ) < • • • < X(„) denote the 
order statistics of Xi,X 2 ,... ,X„ and := F(X(j)). It is well known that t7(i) < U{ 2 ) < 
■ ■ ■ < U{n^ are distributed like the order statistics of n independent random variables with uniform 
distribution on [0,1]. By noting that IE((7(j)) = ti := z/(n-|-1) for 1 < i < n, and using empirical 
process theory, one can show that for any 7 e [0,1/2), the random variable 


y/n max 


\^{i) ^i\ 

{ti{i-ti))^ 


(4) 


converges in distribution to supjg(o,i)(t(l — < oo as n —)■ oo, where B is standard 

Brownian bridge. In particular, the (1 — Q!)-quantile of the test statistic Q satisfies 

0(1). Inverting this test leads to the (1 — a)-confidence band {Ln, Un) for F with 


^WKS _ 


\_Ln{x), Un{x)~^ — 


ti - 


K, 


WKS 

n,Q: 


n 


■{ti{l - ti))'^,ti+l -b 


.WKS 

^n,Q! 


{ti+i{i - ti+i))'> n[o,i] 


for i G {0,1, ..., n} and x G [X(j), X(j^;^)). Here X(o) := — oo and X(^n+i) •= oo- 
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Example (Owen’s band refined). Another eonfidence band which may be viewed as a refinement 
of Owen’s (1995) method has been proposed recently by Dumbgen and Wellner (2014). Let 

p 1 — p 

K (p, p) := plog - + (1 - p) log -- 

p 1 — P 

for p,p G [0,1] with the usual conventions that Olog(-) := 0 and olog(o/0) := oo for a > 0. 
Furthermore, for t G (0,1) let 

C{t) := log(l + logit(t)^/2)/2 and D{t) := log(l + C(t)^/2)/2. 


Then for any fixed u > 2, 


max ((n + - C{tj) - i^D{tj)) (5) 


converges in distribution to 


sup 

* 6 ( 0 , 1 ) 


B{t? 


Cit) - vD{t)^ 


< oo. 


In particular, the (1 — a)-quantile of the test statistic Q is bounded as n —)• oo. Inverting 

this test leads to the following confidence band (L„, Un)- 


Ln (x) 

Ln(x) 

Unix) 

Unix) 

where 


:= 0 for X < 

:= min{p G (0,tj] : Kitj,p) < Jnitj)} for l<j< n,X(j) <x < Aq+i), 
:= max{p G [tj, 1) : Kitj,p) < Jnitj)} for 1 < j < n,Xy_i) <x< Xq), 
:= 1 for X > X^n), 


7n(t) 


Cit) + uDit) + 
n + 1 


Confidence bands for a bi-log-concave F. Now suppose that F belongs to Xbic. Under this 
assumption, a (1 — a)-confidence band (L„, Un) for F may be refined as follows: 

L^(x) := inf{G(x) : G G FucK < G < [/„}, 

U^ix) := sup{G(x) : G G Fuc, K <G<Un}. 


It may happen that no bi-log-concave distribution function fits into the band (L„, Un)- In this case 
we set L° = 1 and U° = 0 and conclude with confidence 1 — a that F 0 Xbic. But in the case 





of F G Fbic this happens with probability at most a. Indeed, the construction of (L°, U°) implies 
that 

<F<K) = <F<Un) if F E Fblc- 


The following algorithm is used to determine the refined band (L°, U°). An essential ingre¬ 
dient is a procedure ConcInt(-, •) (concave interior). Given any finite set T = {foj h, ■ ■ ■, tm} 
of real numbers to < ti <■■■< tm and any pair {£, u) of functions £,u : T —> [— 00 , 00 ) with 
£ < u pointwise and i{t) > —00 for at least two different points t ^ T, this procedure computes 
the pair {i°, u°), where 

l°{x) := inf{p(x) : g concave on M, ^ < 5 < u on T}, 
u°{x) := sup{p(x) : 5 concave on M, f" < 5 < u on T}. 


This is a standard and solvable problem. On the one hand, i° is the smallest concave majorant 
of £ on T which may be computed via a suitable version of the pool-adjacent-violators algorithm 
(Robertson et al. 1988). Indeed, there exist indices 0 < y (0) < y (1) < • • • < y(6) < m such that 


= -00 onM\ 

£° is linear on [tj{^a-i)^tj{a)\ for 1 < a < 6, 
changes slope at tj(^a) if 1 < a < 6. 


Having computed i°, we can check whether i° < u on T. If this is not the case, there is no concave 
function fitting in between i and u, and the procedure returns a corresponding error message. 
Otherwise the value of u°{x) equals 


mm 


in|u(s) 


+ 


u{s) — i°{r) 


s — r 


{x — s) \ r E Tjj, s £ T, r<s<xorx<s<r|, 


where % = • ■ ■ )ty(6)}- To maximise g{x) over all concave functions g such that 

£ < g < may assume without loss of generality that for fixed x and a given value y of g{x), 
the function g is the smallest concave function such that g > £0 and g{x) = y. But the latter 
function is piecewise linear with changes of slope at x and some points in To- Moreover, if y is 
chosen as large as possible, g{s) has to be equal to u{s) for at least one point s ^ T- 

Figure [^illustrates this procedure for T consisting of 21 points. It shows two (parallel) func¬ 
tions £ and u evaluated at all points in T, indicated by bullets and interpolating dashed lines. In 
addition the plot shows the resulting functions £° and u" on T U (—00, to) U (tm, cx)), which are 
displayed as interpolating solid lines. 
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Figure 3: Graphical illustration of the procedure ConcInt(-, •). 


In our context, T is chosen as a fine grid of points such that to < and tm > ^(n) 
{Xi,X 2 ,. . ■, Xn} C T. Tablecontains pseudo-code for our algorithm to compute (L°, [/"). 
We tacitly assume that whenever ConcInt(-, •) returns an error message, the whole algorithm stops 
and reports the fact that there is no G G J^bic satisfying < G < Un- 

The next lemma implies that our proposed new band (L°, U°) has some desirable proper¬ 
ties under rather weak conditions on {Ln, Un)- In particular, both L° and U° are Lipschitz- 
continuous on M, unless inf{x G M : Ln{x) > 0} > sup{x G M : Un{x) < 1}. Moreover, 
if limaj^oo Ln{x) > lima;^_oo Un{x), then U°{x) converges exponentially fast to 0 as x —)> —oo 
while L^{x) converges exponentially fast to 1 as x —)• cx). 

Lemma 2. For real numbers a < b and 0 < r < s < 1 define 

log(s/r) log((l - r)/(l - s)) 

71 := —r - and 72 := -^-r- 

b — a b — a 

(i) If Ln{a) > r and Un{b) < s, then L° and are Lipschitz-continuous on M with Lipschitz 
constant maxjyi , 72 }- 

(ii) IfUn{a) < r and Ln{h) > s, then 

Unix) < rexp( 7 i(x — a)) forx < a 
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{K,U°) ^ {Ln,Un) 

iL,u^ ^ ConcInt(log(L"),log(f7°)) 

iK: U°) ^ (exp(r), exp(n°^) 

{^o, Uo) ^ ConcInt(log(l - ^°), log(l - L")) 
Un) ^ (1 - exp(u°), 1 - exp(r)) 

while (L°,^«)/(L^,i7°)do 
{K,U°) ^ {Ll,U-) 

(£o,Wo) ^ ConcInt(log(L°),log(C/°)) 

(^n> U°) ^ (exp(r), exp(n°^) 

^ ConcInt(log(l - U°),\og{l - Z°)) 
(-^n> U°) ^ (l - exp(w°), 1 - exp(r)) 
end while 


Table 1: Pseudocode for the computation of (L°, [7°). 


and 


1 —-L°(x) < (1 — s) exp(— 72 (x — 6)) forx>b. 

3.1 A numerical example 

We illustrate our methods with a data set from Woolridge (2000). It contains for n = 177 randomly 
chosen companies in the U.S. the annual salaries of their CEOs in 1990, rounded to multiples 
of 1000 USD. Since it is not clear to us how the rounding has been done, we assume that an 
observation Uj^raw £ N corresponds to an unobserved true salary Yi within (Uj^raw — l,l^i,raw + 
1 ), and we consider li, 12 ) • • •, to be a random sample from a distribution function G on 
(0, oo). Salary distributions are well-known to be heavily right-skewed with heavy right tails. A 
standard model is that U ~ G has the same distribution as 10^ for some Gaussian random variable 
X, see Kleiber and Kotz (2003). We assume that the distribution function F{x) := G(IO^) of 
Xi := logio(li) is bi-log-concave. More specifically, we compute an unrestricted confidence band 
(Ln, Un), where L„ is compufed wifh (logio(li,raw + 1))”=! wifh (logio(Ui,raw - 

Figure Qa) shows fhe Kolmogorov-Smimov 95%-confidence bands for F, wifhouf (black 
lines) and wifh (blue lines) fhe resfricfion of bi-log-concavify. Figure |^b) shows fhe confidence 
bands based on fhe weighfed Kolmogorov-Smirnov 95%-confidence band, where 7 = 0.4. The 
corresponding quanfiles have been esfimafed in 2 • 10® Monfe Carlo simulations. In bofh cases 
fhe shape consfrainf yields a subsfanfial gain of precision. Nofice also fhaf fhe bounds in Fig- 
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(a) Kolmogorov-Smirnov confidence bands: 




Figure 4: Estimated distribution function with unconstrained and constrained confidence bands 
for CEO salaries. 

ure Qb) are tighter in the tails but slightly wider in the central part than those in Eigure Qa), for 
the unconstrained band as well as for the band with shape constraint. 


4 Consistency properties 

In this section we study the asymptotic behaviour of the proposed conhdence band (L°, U°) when 
F G J^bic- Or goal is to pinpoint the benehts of utilizing the shape constraint of bi-log-concavity. 
Ah asymptotic statements refer to n —)> oo while F is hxed. 

We start with rather general consistency results for (L°, U°). Recall that we set L° = 1 and 
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?7° = 0 in the case of no G G J^bic fitting in between Ln and Un, concluding with confidence 
1 — a that F 0 J^uc- The supremum norm of a function /i : M — )■ M is denoted by ||/i||oo = 
suPa;g]R \h{x)\, and for itT C M we write ||/i||k,oo := sup^.^^ \h{^)\- 

Theorem 3 . Suppose that the original confidence band {Ln, Un) is consistent in the sense that 
for any fixed x G M, both Ln{x) and Un{x) tend to F(x) in probability. 

(i) Suppose thatF 0 J^bic- Then P(L° < C/°) —)• 0. 

(ii) Suppose thatF G Fuc- Then ]P(-L° < U°) > 1 — a, and 

sup ||G - F||oo 0 , 

• Ln^G^Un 

where sup(0) := 0. Moreover, for any compact interval K C J{F), 

sup Who - hF\\K,oo -^p 0 , 

GG^blc • Ln^G’^Un 

where ho stands for any of the three functions G', log(G)' and log(l — G)'. Finally, for any fixed 
xi G J(F) and bi < f{xi)/F{xi), 

lP(^U°{x) < Un{x') exp{bi{x — x')) for X < x'< xi) —)■ 1 , 

while for any fixed X2 G J{F) and 62 < /(x2)/(l — F{x2)), 

P(l —-L°(x) < (1 — L„(x')) exp(— 62 ( 2 : — x')) for X > x'> X 2 ) —> 1. 


A direct consequence of Theorem are consistent confidence bounds for functionals f cj) dF 
of F with well-behaved integrands </> : M —M: 

Corollary 4. Suppose that the original confidence band (L„, Un) is consistent, and let F G -fbic- 
Let (/) : M —)• M be absolutely continuous with a derivative (f)' satisfying the following constraint: 
For constants a G M and 0 < 61 < Ti{F), 0 < 62 < T2{F), 


|(/)'(x)| < exp(a + 6 ix +b 2 X~^) 


with x^ := max{±x, 0}. Then 


sup 


(j)dG- / ^dF 


The previous supremum is meant over all distribution functions G within the confidence band 
(L°, U°), which is larger than the supremum over all distribution funcions G G J^bic between Ln 


13 




and Un- Corollaryapplies to (j){x) := with —Ti{F) < t < T 2 {F). Indeed, the proof of Q 
implies the following explicit formulae in the case -L° <K- 


G: 


inf 


./■ 


,tx 


G{dx) 


sup 


Ax 


G{dx) 


{1 — U°{x)) dx if f > 0, 
(x) dx ift< 0 , 

— L°(x)) dx if f > 0 , 
|f|e*^f7°(x) dx if t < 0 . 


Now we refine Corollary [^by providing rates of convergence, assuming that the original con¬ 
fidence band (L„, Un) safisfies the following property: 


Condition (*) For certain constants 7 G [0,1/2) and k, A > 0, 
max{F„ - L„, --^n} < 

on the interval < 1 — 

Obviously this condition is satisfied with 7 = 0 in the case of the Kolmogorov-Smimov band. 
For the weighted Kolmogorov-Smirnov band it is satisfied with the given value of 7 G [0,1/2). In 
the refined version of Owen’s band, it is satisfied for any fixed number 7 G (0,1/2). 


Theorem 5. Suppose that F G Fbic, and let {Ln, Un) satisfy Condition (*). Let < 
absolutely continuous. 

(i) Suppose that \4>'{x)\ = 0(|x|^“^) as jxj —00 for some number k > 1. Then 


sup 


^dG- / (/.dF 


Op[n ^/^(logn)^) 1/7 = 0 , 

1/7 > 0 . 


(ii) Suppose that cf) satisfies the conditions in Corollary^ Then 


sup 


^dG- / ^dF 


= Op{n ^) 


for any exponent j5 G (0,1/2] such that 

l-max{ 6 i/ri(F), 62 /T 2 (F)} 


/3 < 


2 ( 1 - 7 ) 


he 


( 6 ) 


The addifional factor (log n)^ in part (i) cannot be avoided. To verify this we consider (j){x) = 
x^ and the distribution function F of a standard exponential random variable X, i.e. F(x) = 
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1 — e“* for X > 0. Further let Fn be the conditional distribution function of X, given that 
X < Xn ■= (logn)/2 — logc with a fixed c > 0. Then both F and are bi-log-concave, 

\\Fn — -^lloo = but 

J cj)d{Fn -F) = JEiX'^) - m{X^ \X<Xn) 

= P(X > Xn){^{X^ \X>Xn)- IE(X^ I X < Xn)) 

> P(X > Xn){x^n - ]E(X^)/]P(X < Xn)) 

= 2“^cn“^/^(logn)^(l-h o(l)). 


Consequently, if we use the Kolmogorov-Smirnov confidence band, fhe asympfofic probabilify of 
n^/^||Fn — -F||oo < — c is sfricfly positive, provided fhaf 0 < c < limn->.oo fi^n,o- Buf fhen Fn 

satisfies n^^'^\\Fn — Fn\\oo < ^n,a> so L'^ < Fn < 11°, and fhe A:-fh momenfs of F and Fn differ 
by 2“^cn“^/^(logn)^(l -|- o(l)). 

If (L", U°) is consfrucfed wifh fhe refined version of Owen’s confidence band, we may choose 
7 arbifrarily close fo 1/2, so fhe ferm 2(1 — 7 ) is arbifrarily close fo 1. Thus Q holds for any 
exponenf /3 G (0,1/2] such fhaf 

(3 < l-max{ 6 i/ri(F), 62 /T 2 (F)}. 


In particular. 


sup 


G{dx) 


whenever —Ti{F)/2 < t < T2{F)/2. 


F{dx) 


Op{n ^/^) 


5 Proofs 

When proving Theorem [T] we assume fhaf fhe reader is acquainfed wifh fhe following facls abouf 
concave functions: 

Lemma 6. Suppose that /i : M — [— OO; + 00 ) is a concave function. Then it satisfies the follow¬ 
ing properties: 

(i) h is continuous on the interior of {h > — 00 } := {x G M : h{x) > — 00 }. 

(ii) For each interior point x of {h > — 00 }, the left- and right-sided derivatives h'{x —) and 
h'{x -h) exist in M and satisfy h'{x —) > h'{x -|-). Moreover, h{x ±) is non-decreasing in x. 
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(in) For each interior point x of {h > —cx)} and a G [h! {x +), h! {x —)], 


h{x + i) < h{x) + at for all t G M. 


Here is a second useful result: 

Lemma 7. Let h be a real-valued function on an open interval J C M, and let [a, b] G [—00,00]. 
Then the following two statements are equivalent: 

(i) For arbitrary different x,y G J, 

y-x 

(ii) For arbitrary x G J, 

. h{y) - h{x) h{y) - h{x) 

liminl - > a and limsup - < b. 

y^x y - X y^x y - X 


In the case of [a,b] = [0, 00] or [a, 6] = [—cx),0], part (i) is equivalent to h being non¬ 
decreasing or non-increasing, respectively. In the case of [a, 6] C M, part (i) is equivalent to h 
having an -derivative h' on J with values in [a, 6]. 

Lemma follows essentially from a bisection argument and the following observation: For 
points r < s < t in J, 

h{t) - h{r) h{s) - h{r) h{t) - h{s) 

- = a -h (1 — a)- 

t — r s — r t — s 


with a := {s — r)/{t — r) £ (0,1). In particular, 


h{t) — h{r) 
t — r 




in| 


> min 
< max 


h{s) — h{r) h{t) — h{s) 
s — r ’ t — s 
/i(s) — h{r) h{t) — h{s) 
s — r ’ t — s 


}. 

}■ 


Proof of Theoremlll Equivalence of (i-iv) will be verified in four steps. 

Proof of (i) (ii). Suppose that F is bi-log-concave. Since log F is concave, it follows from 

Lemma|^that F is continuous on {a, 00 ), where a := inf{F > 0}. Furthermore, concavity of 
log(l — F) implies that F is continuous on (— 00 , b) with b := sup{F < 1} > a. But a < b, 
because otherwise F would be degenerate. Hence F is continuous on M. In particular, J (F) is the 
open and nonvoid interval (a, 6). 
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Concavity of h := logF implies that for a < a: < 6 its left 
h'{x —), h'{x +) exist in M and satisfy h'{x —) > h'{x +). But then 

FUx±) = lim + ^ 

^ t-5-0,±t>0 t 

exist in M, too, and satisfy the inequalities 

F'{x-) > F'{x+). 

Analogously one can deduce from concavity of h := log(l — F) that 

-F'(x-) = (l-F)'(x-) > (1-F)'(x+) =-F'(x+), 

so that F'{x —) = F'{x +). This proves differentiability of F on J{F). 

Finally, the inequalities ([T]l follow directly from the last part of Lemma|^ applied to h = log F 
and h = log(l — F). 

Proof of (ii) =► (iii). Suppose that F is continuous on M, differentiable on J{F) with derivative 
f = F' and satisfies the inequalities ([T]l. This implies that h := f/F is non-increasing and 
h := //(I — F) is non-decreasing on J{F). For if x,y £ J{F) with x < y, then by ([T]), 

logF(x) < log F{y) + h{y){x - y) 

< logF{x) + h{x){y - x) -I- h{y){x - y) 

= logF{x) + {h{x) - h{y)){y - x) 


- and right-sided derivatives 


F{x)h'{x ±) 


and 


log(l-F(x)) < log{l - F{y))-h{y){x-y) 

< log(l - F{x)) - h{x){y -x)- h{y){x - y) 

= log(l - F{x)) + (h{y) - h{x)) {y - x), 

whence h{x) > h{y) and h{x) < h{y). 

Proof of (iii) ^ (iv). Suppose that F satisfies fhe condifions in parf (iii). Firsf of all Ibis implies 
/ > 0 on J{F). Suppose /(xq) = 0 for some Xq £ J{F). Then isofonicify of h = //(I — F) 
implies /(x) = 0 for x < Xq, and anfifonicify of h = f /F implies /(x) = 0 for x > Xq. Hence 
F would be consfanf on J{F), which violates fhaf F is a confinuous disfribufion function on M. 
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Another consequence of these monotonicity properties is boundedness of / on J{F)-. If we fix 
any Xo G J{F), then for any other point x G J{F), 


fix) = 


F{x)h{x) < h{xo) ifx>Xo, 

(1 — F{x))h{x) < h{xo) if X < Xo- 


Finally, local Lipschitz-continuity of / may be verified via Lemma]^ Let c, d G JiF) with c < d. 
For arbitrary different x,y £ (c, d), 

fiv) - fix) F{y)h{y) - F{x)h{x) 


y-x 


y-x 


= h{y) 

Fiy) 

-Fix) , 

-^ + F X 

y 

— X 

< h{c) 

Fiy) 

-F(x) 

y 

— X 

< hie) 

exp(/i(x)(y — x)) — 1 


hjy) - h{x) 
y-x 


y-x 

h{c)h{x)F{x) < h{c)^F{d) 


F{x) 


as y —> X. Hence 

limsup^^-^^^- < h{c)‘^F{d) for all x G (c, d) (7) 

y^x y X 

Analogously one can show that 

liminf ^^-^^^—— p(^c)) for all x G (c, d). (8) 

y^x y-x 

In particular, / is Lipschitz-continuous on (c, d) with Lipschitz-constant 

max{/i(c)^F(d), /i(d)^(l — F(c))}. 

This proves local Lipschitz-continuity of / on JiF). In particular, / is absolutely continuous with 
L^-derivative /'. This means, f is a locally integrable function on JiF) such that 

fiy)-fix)= f fit)dt forallx,y G J(F), 

J X 


and it may be chosen such that 

/'(i) e 


li„, inf /teWM, ii„. sup F'> - 

y^x y-x y^x y-x 


for any x G JiF). But for c, d G JiF) with c < x < d, the latter interval is contained in 

-/(d)2(l-F(c)) fic)^F{d)- 


[-h{d)\l-F{c))Mc)^nd)] = 


(1-F(d))2 


F(c) 
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according to Q and ([^. Since F and / are continuous, letting c,d ^ x implies Q. 

Proof of (iv) =► (i). One can easily verify that a continuous distribution function F is bi-log- 
concave if, and only if, log F and log(l — F) are concave on J{F). Hence (i) is a consequence of 
(iii), and it suffices to show that (iv) implies (iii). 

According to Lemma h is non-increasing on J{F) if, and only if. 


lim sup 

y^x 


h{y) - h{x) 
y -X 


< 0 


for any x G J{F). To verify this, let y G J{F) \ {x} and set r := min(x,y), s := max(x,?/). 
Then it follows from Q and from continuity of / that 

hjy) - h{x) ^ f{y)/F{y) - f{x)/F{x) 
y — X y — X 


1 f{y) - fix) fix) F{y) - F{x) 


Fiy) 


y -X 


1 


< 


Fiy)is-r) 

1 


fit) dt - 


Fix)F{y) y- s 

fix) 


dt — 


Fix)F{y){s - r) 

fix) 


F{y)is-r) Jr F{t) F{x)F{y){s - r) 
/(x)2 /(x)^ 


fit) dt 
^ fit) dt 


F(x)2 F(x)2 


= 0 


as y —)■ X. 

Analogously one can show that h is non-decreasing on J(-F). 


□ 


Proof of Q. For any fixed Xq G JiF), monotonicity of f /F = log(-F)' implies that for x G 
J(-F), X < Xo, 

■f f \ ^ logi^(xo) - logF(x) 

F^ x — Xo 

Since logF(x) —)• —oo as x —)• inf(J(F)), this inequality implies that 


TiiF) = sup ^(x) 

x&J{F) X 


lim t^ix) 
a:-s.inf(J(F)) F 


> 0 , 

= 00 if inf(J(F)) > — 00 . 


Analogously one can show that 


T2iF) 


sup 

x£J(F) 


f 

1-F 


(x) 


lim 


/ 


x->-sup(J(F)) 1-F 


(x) 


> 0 , 

= 00 if sup(J(F)) < 00 . 


For symmetry reasons it suffices to show that f e*^F(dx) is finite for t G (0,T2(F)) and 
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infinite for t > T 2 {F). Notice that for t > 0, Fubini’s theorem yields 

J e^^F{dx) = J J dz F{dx) 

— exp(tz + log(l — F( 2 ;))) dz. 

In the case of m := sup( J(F)) < oo, the previous integral is smaller than < oo for f < oo = 
T 2 {F). In the case of m = oo, notice that tz + log(l — F{z)) is concave in z G M with limit —oo 
as z —)• —oo. Thus the integral f F{dx) is finite if, and only if, 

lim ^(tz + log(l-F(z))) = lim (t - \ =t-T 2 {F) 

2 -S-OO dz ' ' 2^00 V 1— i^(z)/ 

is strictly negative, which is equivalent to f < T 2 {F). □ 


Proof of Lemma 1^ The assertions are trivial if = 1 and U° = 0, meaning that no G G 
fits in between and Un- Otherwise let G G J^bic such that Ln < G < Un- 

For part (i) it suffices to show that for any x G J{G) the density g = G' satisfies the inequality 
g{x) < max{ 7 i, 72 }. This is equivalent to Lipschitz-continuity of G with the latter constant, and 
this property carries over to the pointwise infimum and supremum U°. For x > 6 it follows 
from concavity of log G and G{a) > r, G{b) < s that 

! \ ^ 9 ! \ ^ 9 ^ logG(6) - logG(a) log s-log r 

9 {^) < gW < gW < -= 71. 

Similarly convexity of — log(l — G) and the inequalities G{a) > r, G{b) < s imply that for 
X < a, 

^ 9 ^ S' ^ ^ / -log(l - G( 6 ))+log(l - G(a)) 

g{x) < - -77(x) < ---(a) < -^- < 72. 


1-G^ ^ - 1-G 
For a < X < b we get the two inequalities 


b — a 


/I \9 f \ ^ nr JogG{x) - logr 

g{x) = G{x)-{x) < G{x) --—-- 

v_7 X d 


and 




The former inequality times x — a plus the latter inequality times b — x yields that 
G(x) log(G(x)/r) + (1 - G(x)) log((l - G(x))/(1 - g)) 


g{x) < 


b — a 
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But h{y) := y\og{y/r) + {1 — y) log((l — y)/(l — s)) is easily shown to be convex in y G( 0 , 1 ), 


so 


g{x) < max h{y) = max{ 7 i, 72 }. 

y=r,s 


As to part (ii), it suffices to show that G{x) < G{a) exp( 7 i(x — a)) for a: < a and G{x) > 
1 — (1 — G{b)) exp(— 72 (x — b)) for x > b. We know from Theorem(ii) that this is true with 
{g/G){a) and {g/{l — G)){b) in place of 71 and 72 , respectively. But it follows from G{a) < r, 
G(b) > s and concavity of log G that 


5 logG(6) - logG(a) log s-log r 

g'“> - -- - b-a 


71, 


while convexity of — log(l — G) yields that {g /(1 — G)){b) > 72 . 


□ 


Proof of Theorem 13 Suppose that F 0 T^bic, that means, log F or log(l — F) is not concave. In 
the former case there exist real numbers xq < xi < X 2 such that log F{xi) < (1 — A) log F(xo) + 
AlogF(x 2 ), where A := (xi — xo)/(x 2 — xq) £ (0,1). Then with probability tending to one, 
log Un(xi) < (1 — A) log Ln(xo) + A log Ln(x 2 ), whcncc no log-concave distribution function fits 
between and Un- Analogous arguments apply in the case of log(l — F) violating concavity. 

Now suppose that F G J^bic- Obviously, ]P(T° < U°) > ]P(T„ < F < Un) > 1 — a. Since 
Ln and Un are assumed to be non-decreasing, and since F is continuous, a standard argument 
shows that pointwise convergence implies uniform convergence in probability, i.e. 11 —F 1100 -^p 
0 and \\Un — F\\oo —)-p 0. This implies that 

sup ||G-F||oo < \\Ln- F\\oo + \\Un- F\\oo -^p 0, (9) 

GG^blc : Ln^G^Un 

because < [/^ < Un in the case of < U^. 

Now let A' be a compact subset of J{F), and let he ’■= log(G)' for G G Able- Since hp = 
//F is continuous and non-increasing on J{F), for any fixed e > 0 fhere exisf poinfs oq < ai < 
■■■< am < ttm+i in J{F) such fhaf K C [ai, am] and 

0 < hpiai-i) — hF{ai) <e for 1 < f < m-|-1. 
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For G G Tuc with Ln < G < Un, for any x € K it follows from monotonicity of hp and he that 


sup (heix) - hpix)) < max (hdai) - hpiai+i)) 


< max 
2 = 1 \ 


/logG(aj) - logG(oi_i) 


^i—1 


— hpiai+i 


< 


max 

iV Oj — Oj—i / 

/logF(aj) - logF(ai_i) 


= max . 

1 \ 


^i—1 


+ Op(l) 


< max (hpiai-i) - hF{ai+i)) + Op{l) 


< 2e + Op(l). 


Analogously, 


sup (hpix) - heix)) < max (hpiai) - hF{ai+ 2 )) + Op{l) 

< 2 e + Op(l). 

Since e > 0 is arbitrarily small, this shows that 

sup ||log(G)'- log(F)'|| = Op(l). (10) 

G(^Tuc-L„<G<Un 

Analogously one can show that 

sup ||log(l - G)'- log(l - F)'|| = Op(l). 

G(^TMc-Ln<G<UN ’ 

Moreover, since G' = log(G)' G, it follows from Q and ( fTO] ) that 

sup \\G'- F'\\k,oc = Op(l). 

GSAjIc • Ln<G<UN 


Finally, let xi < sup(J(F)) and hi < f{xi)/F{xi). As in the proof of Lemma(ii) one 
may argue that for any fixed x'l > xi, x[ G J{F), 


V x^ — xi / 

logF(x'^) — logF(xi) 


for all X < x' < xi- But 

log(x'l) - log(7„(xi) 


x'l — Xl 


x'l — Xl 


> h 


if Xl < inf(J(F)) or x'l is sufficiently close to xi G J{F). This shows that with asymptotic 
probability one. 


U°{x) < C/„(x') exp(6i(x - x')) 


for all X < x' < Xl- Analogously one can prove the claim about 1 — on halflines [x 2 ,oo), 
X 2 > inf(J(F)). □ 
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Proof of Corollary]^ Without loss of generality let 0 G otherwise we could shift the 

coordinate system suitably and adjust the constant a in our bound for \(j)'\. Notice that for any 

z G M, 

/ OO 

(l[ 0 <x<d - \z<x< 0 ])(li'{x) dx, 

-OO 

so by Fubini’s theorem, 


provided that 


(l)dG = (t>{0)+ f G{x)) dx, 

Jm 


\(t>\x)\\li^>o] - G{x)\dx < OO. 


( 11 ) 


By assumption, for arbitrary numbers G (0, Ti{F)) and 63 G (0, T 2 {F)) there exist points 
xi,X 2 G J{F) with xi < 0 < X 2 and 

f{xi)/F{xi) > b[, f{x 2 )/{l-F{x 2 )) > 62 . 

Then it follows from Theorem [^(ii) that with asymptotic probability one, 

Unix) < Unix') exp(5j(x — x')) for X < x' < Xi 


( 12 ) 


and 


1 — L°(x) < (1 — L„(x')) exp(— 62 (x — x')) forx>x'>X 2 . 


(13) 


If we choose > bi and b '2 > 62 , the inequalities ( [T^ and ( [T3l ) imply ( [TT] ) for arbitrary dis¬ 
tribution functions G with Ln < G < 17 °- More precisely, for any fixed c > 0 and 5 := 
min{ 6 j — 61 , ^2 — 62 } > 0 , 

rxi—c nxi—c 


/ xi—c pxi—c 

\(l)'ix)\U°ix) dx < Unixi) / expia - bix + b'lix - Xi)) 

-OO j —OO 


dx 


< Unixi) expia — hixi — 6 c) / Qxpi5y)dy 

J —OO 

Unixi) exp(a — hixi — 6 c) 


and 


roo 

/ \^'ix)\il - L'^ix)) dx < 

J X2+C 


(1 - Lnixi)) exp(a + 62 X 2 - 6 c) 


The same inequalities hold if L„, Un, Ln and 11° are all replaced with F. Thus 
sup / (j) dG — 4> dF = sup 


/ OO 

ix)iF - G)ix) dx 

-OO 


(14) 
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is not larger than 


sup \\G — F 


|•X2+C 

loo / \(l)'{x)\dx 

J Xi —c 


+ 


/ Xl—C poo 

\cP'{x)\{K + F){x)dx+ / |</.'(x)|( 2 -L°-F)(x)dx 

-OO Jx2-\-C 


^ 2 F(xi)exp(a-bixi - 5 c) 2(1 - F(x2)) exp(a + 62X2 - ( 5 c) 

< - jj - + 0 ,( 1 ). 

But the limit on the right hand side becomes arbitrarily small for sufficiently large c > 0 . □ 


Proof of Theorem m It follows from standard results about the empirical process on the real line 
that for any fixed e G (0,1) fhere exisfs a consfanf Kg > 0 such fhaf wifh probabilify af leasf 1 — e, 

\Fn-F\ < Ken-^/\F{l - F))'^ 

on M. Lef us assume fhaf fhe previous inequalifies hold and fhaf < U°. 

For a consfanf Ag > 0 fo be specified lafer if follows from < F’ < 1 — 

fhaf 

Fn > (1- > (1 - KgAr^)Agn-i/(2-27) ^ (Ag - KgAJ)n-i/(2-27) 


and 

1-Fn > (Ag-//gAJ)n-l/(2-27). 

Thus we choose Ag sufficienlly large such fhaf fhe number Ag — KgAj exceeds A. Then fhe inferval 

:= {Agn-V(2-27) < F < 1 - Agn-V(2-27)} 

is a subsef of {An 1/(2 < 1 — An On fhis interval J„, 


Fn{l - Fn) 


< max 


^Fn LJ^X < l + _ 

If’ 1-F/“ mi 


if; - F\ 


< 1 + KgAJ 


min(F, 1 — F) 


F{l-F) 

and for any function h wifh Ln < h < Un, 

\h-F\ ^ \h-Fn\ /Fn{l-Fn)\'r , \Fn-F\ 


< 


+ 


< ngn-1/2 


( 15 ) 


(F(l - F))7 - (F„(i _ f„))7 V F(1 - F) J (F(l - F))7 

wifh i/g K(l + KgAg )7 + Kg. In particular, fhe boundaries and Un fhemselves salisfy ( fTS] ) 
on Jn- 

Again we assume wifhouf loss of generalify fhaf 0 G J{F). For arbifrary fixed numbers 
b[ G ( 0 , ri(F)) and b'2 G (0,r2(F)) we choose poinfs xi,X2 G J{F) wifh xi < 0 < X2 such 
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that f{xi)/F{xi) > b[ and f{x 2 )/{l — F{x 2 )) > ^ 2 - For sufficiently large n, [xi,X 2 ] C Jn, 
and we may even assume that ( [T^ and ( [T^ are satisfied, too. Wrifing = [xni,Xn 2 ], we may 
deduce from ( [T4| ) and ( [T5| ) thaf 


sup 


(t)d{G-F) 


< 


- 1/2 



\(f>'{x)\F{xy {1 — F{x)y dx 


/ ^nl 

\cl 2 '{x)\{F + K){x)dx 

-OO 

1*00 

+ / W{x)\{2-F - L°J{x)dx. 

Xn2 


Notice fhaf 


F{x) < F{xi) ex.p{b[{x — xi)) forx<xi, 

1 — F{x) < {1 — F{x 2 )) ex.p{—b 2 {x — X 2 )) fora:>X 2 . 

In particular, for x = Xni,Xn 2 it follows from fhese inequalities and F{xni) = 1 — F{xn 2 ) = 
fhaf 


‘ ’ m^)' 

Notice also fhaf by ( fTS] ), ( [T^ and ( [T5] ), 

(F + [/°)(x) < {F + U°){xni) eyip{b'i{x - Xnl)) 

< exp(6'^(x — Xni)) for x < Xni, 

{2 - F - L^){x) < ex.p{-b2{x - Xn2)) for x > Xn2, 

where iOp := Ag + i'pX2- These considerafions show fhaf 


sup 


(t)d{G-F) 


F InO + Ini + I'nl + In2 + l'n2 


wifh 


pX2 

InO := ye'rr^l'^ / \(l)'{x)\dx = 0{n~^/‘^), 

J Xl 

Ini ■= f \(l)' (x)\F{xy dx = j \(f)'dx\, 

Jxnl V Jxnl / 


V •= 

^nl * 

J — 00 

rXn 2 

In2 := / 

In2 ■■ = 


(16) 


\^{x)\{F FU°^){x)dx = O ra-^/( 2 - 27 ) / dx 

-00 \ J—00 J 

\4> {x)\{l — F{x))'^ dx = |(/)'(x)|e“'^^2^ dxy 

/•OO / poo \ 

/ \(l)'{x)\{2-F -L2,){x)dx = O n-i/( 2 - 27 ) / . 

J Xn2 V 'J Xn2 / 
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As to part (i), suppose that |i;/>'(x)| < a(l + \x\^ for arbitrary x G M and some eonstant 
a > 0 . Then both Ini and In2 are of order 


O 


f>0(logn) 


(1 + exp(—76's) ds = 


0{n 


if 7 > 0 , 


0(n ^/^(logn)^) if 7 = 0, 
where b' := min{6'^, 62} > 0 . Moreover, both and 1^2 are of order 

j o(n“^/^) if 7 > 0, 

|^0(n“^/^(logn)^“^) if 7 = 0. 

This proves the assertion in part (i). 

For funetions <p as in part (ii), let b’l > bi and h’2 > 62 sueh that bi / 76'^ and 62 / 762- Then 

f>0(l)+(log n)/{b\ (2-27)) 


Ini = 


exp((6i — 76 ']^)s) ds^ = 0{n 


with 


and 


_ 1 (61-76;)+ _ 1 - 7 - (61/6; - 7)+ _ 1 - max(6i/6;,7) 

• o U 


2 6;(2-27) 


2 ( 1 - 7 ) 


2 ( 1 - 7 ) 


. « 1 - max(62/6'2,7) 

In2 = 0(n with 132 ■■= -77--r+-• 

2(1 - 7) 


Furthermore, 


I'ni = O^n J exp{—bix + b'i{x — Xni)) dx^ 

= exp(—6iXni) J exp(—(6^ — 6i)s) ds 

= 0(n-i/(2-27)gxp(-6^Xni)) = 0(n-(i-^i/^'i)/(2-27)) = O(n-^i) 


and 


I'n2 = 0{n-P-). 


This proves the assertion in part (ii). If 7 := max|6i/Ti(F), 62/T2(F)} < 7, we may ehoose b[ 
and 6; sueh that 61/6;, 62/6^ < 7, resulting in / 3 i = /32 = 1 / 2 . If 7 > 7, the exponents / 3 i, /?2 are 
strietly smaller than but arbitrarily elose to (1 — 7)/(2(1 — 7)). □ 


Acknowledgement. Construetive eomments by two referees are gratefully aeknowledged. 
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